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« determining non-aircrew officer grade requirements. The methodology tested was an extension of the Officer Grade 
Requirements (OGR) procedure developed during the\1963—1966 time period. In the OGR project, a criterion 
board rated 3,575’ officer jobs for grade, then a nine-variable multiple regression ‘equation was developed which 
-efficiently predicted the criterion ratings. ° +: 


« In the current application, the METs rated 4p officer jobs | from the OGR job santple and 1,687 new jobs. For, 
‘the 485 job sample, predicted composite scores were obtained {rom MET, ratings utilizing the nine-variabfe regression 


* -DD Coe 1473s Eni Ti6N OF t Nov 6815 OBSOLETE, Unclassified 
- w 5 fi * P . ‘ EC SECURITY CLASSIFICATION OF THIS PAGE (When Data Entered) 
cae t i phe geo 


. e J \ . 
. s* 2 Unclassified  *  "_s- a? .! 
SECURITY CLASSIFIGATION OF THIS PAGE(When Data-Entered) 


. 
? a Sa” ng s 


Irem 20 (Continued) \ ~~ : : 
e 


equation. These’ scores Were correlated with the criteridn board ratings on jhe same jobs, producing a validity 
coefficient of .90. An ihterrater celiability of .95 ‘on the total 2,172 jobs was obtained for these raters. These results 
indicate that METs can reliably rate officer jobs for deternt an of grade and can accurately replicate the criterion 
board ratings. ° ; . ‘ 


_ +» Recommendations were made for operational implementation and for further research to provide a more 
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This research was completed under Project 7734, Development of Methods} for 

” Describing, Evaluating, and Structuring Air Force Occupations; Work Unit 77340207, 
Development of Methods for Evaluation of Appropriate Grades for Officer Positions. The 
work unit’ was established in response to a Request for Personnel Reséarch (RPR 74-20) 
submitted by Hq USAF/PRMRE and DPXX titled “Development sand testing of an ‘ 
» Officer Grade Evaluation technology.” The RPR requested the development and testing 
of a method by which agement engineering teams -(MET), could, determine the 
appropriate grade he bhetY a nts for individual officer positions- based on job content and “ 
responsibilities. The methodology tested represents a modification and extension of the 
Officer Grade Requirements (OGR) technology developed during the 1963~1966 time 
- period. Interim results of the present MET 1974 study were reported by Christal (1975) 


and a procedural Bae, to impleme method, was prepared by ait and payne 
(1975). , 


*In accomplishing the ‘dull Siete of RPR 74.20, ce and appreciation is 
“,e%pressed to the following individuals: 


HQ USAF — Maj Joseph S. Kittle, RPR Requirements aor AF/PRMRE 
AFHRL -— __ Dr. Raymond E. Christal, Technical Director, Corupaiones 
and Manpower Research Division + 


Colonel James B. Carpenter, Chief, eee and Manpower 
Research Division (November 1974 — June 1975) 
Mrs. M. Joyce Giorgia, Scientific Assistant ar 
Mr. Kenneth G. Koym, Task Scientist 
_ Sgt Johnny J. Weissmuller, Computer Specialist 
AIC Patrick A. Zumbro, Scientific Assistant 
* Mrs. Maria M. Courtney, Typist 


This study does not constitute authority to alter existing Air Force officer grades. - 
Further action towards such, objectives is.a function of HQ USAF/PRMRE and is 
recdmmended only after certain prescribed additional arch. 
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j ao > ‘kt INTRODUCTION 8 


'. _* This report describes the application‘ of a methodology by which management engineering teams 
(MET) can apply job @Zaluation factors to determine appropriate grade requirements officer positions. 
The method represents a modification and extension of the Officer-Gradé Requirements (OGR) technology 
developed during the 1963-1966 time period.’The OGR study identified a set of job evaluation factors and 

%: to be appropriate for evaluating grade requirements based on job content 


weights which wer¢ demons 
65). After a réview of the major features of the OGR project and crim 


and: respongibilfties (Christa 
4 follow-on research, the appli n of the grade evaluation technology by. METsi is dis d. 


we 2 | 


« * . af > 


fe Fs 
mF Eee 7 dy ree “aL OFFICER GRADE by aesslaeaiecidll RESEARCH 1963-1966 4 
The oGR 1963- 1966 studies took haces in shies phases: ae el 


Phase _1. Job sampling and Policy Board Ratings (Hazel? 1965; Hapeats Christ 1966): 
Approximately 80,000, job descriptions were completed by officers in the fietd. From the 80,000 joP set, a 
representative ‘ample of 3,575 job destfiptions was selecfédas a criterion sample. A USAF Policy Board, 
consisting of 22 colonels with considerable Air Force experience, independently evalpated-and assigned 
" grades for each. description. ‘Exceptionally high interrater agreement (r = .92) was found between Policy 

Board members in their ratings of grades for jobs. On, an additional confidence-in- -rating scale, Board 
members @kpressed high confidence in their own ratings. Biases did not appear toward jobs in any 
command or specialty. Board members tended to agree oh the specific jobs they felt were misgraded, and 
agreed pn fhe dige ction and magnitude of the grade changes needed. The conclusion of the gnalyses was 

. that each job was critically evaluated on its own merit according.to its content and responsibility level. 


m, Phase 2. Development of the Policy Euviation (Hazel, Christak & Hoggatt, 1966): Job evaluation* 


factors used by the Policy Board members in assigning grades were identified and incorporated into a Policy 
Equation. The factors identified were: (a) special training and work experience, (b) communication skills, ; 
Ac) judgment and decision making, (d) planning, ande) management. The other four variables included in 
the Policy Equation were: (f) méan grade rating from raters, (g) organizational level of the job, (h) ‘level of 
the job within the organization, and (i) supervisor's judgmentlof grade. Ratings on each of these factors and. 
variables were averaged, weighted, and summed to produce, composite scores, which i in turn were converted 
: into grade ratings. =, ' : Z 


In addition to the first five job evahuatiog factors, five other frclor were rated but did not enter the 
policy grade-cquation. These factors were: formal education; working conditions; originality, ingenuity, and 
creativeness; interpersonal skills; and risk. ; eo 


“Phase 3. Application of the Policy. Equation (Christal, 1965): As a-part of validating the Policy 
Equation, Policy Board ratings from a subset of 1,750 criterion jobs were compared. to the grades assigned 
the same jobs by fWe Policy Equation from raters in the field. These two sets of grade scores correlated .93 
and had approximatelyequal means and standard: aii It-was aangited that the Policy Equatidh had 
shown high stability across time and judges. , 8 : 


From approximately 11,000 officer job descriptions which had been collected and rated, it was 
possible to make’ projections as to how the grade’ structure of the Air Force might change ifthe Policy ’ 
Equatiop was universally applied to determine appropriate grades: for jobs. Results of the projections 
indicated that changes in grade allocations would have\to be made in many officer utilization fields to bring 
statements of grade requirements into line with job demands. In some utilization fields, grade requirements - 
appeared to be grossly overstated; in others they wert understated. In every utilization field some jobs were 
overgraded while others were undergraded. Overall, the OGR project indicated ‘thet in 1964 the Air Force 

_ was some what unaicgeaded at the colonel andlieutenant Saket levels and considerably undergraded at ‘the 
major level. \ 


Developme at of Benchmark ‘Scales. (Brokaw & Sse. 1966): Critical to deriving an appropriate ~ 


‘grade for individual officer positions was the development at reliable ES TENE Deasuen ss for each of the 


u 


job factors‘in the Policy Equation. In 1966, benchmark scales were developed for each factor using job ; | 
titles. For each level, job titles with high interrater agreement and low standard deviations in ratings were 6 
chosen. These scales were validated against ‘1,000 officer positions taken from the 3,575 criterion sample, ee: 
and a simplified integer-weight grade equation was developed for operational application to officer iv | 
positions. The job grades provided by this equation, duplicated those of the original Policy Board (r=.90). ~ 2°? 


The research “methodology and instruments which have to nth been reviewed formed the structure si tie 


MET 1974" research was bastd. ' \ ‘e. 
-Il. THE MET 1974\STUDY ‘ 9 
The; development of the MET 1974 study’ involved| the fattoedag phases: (a) the 1966*benchmark + a He 
scale jobAitles were reviewed for currency and substitutes were selected when necessary, (b) a sample of job fi" 


to determine if MET raters could produce‘, \ | 


* x 


* descriptjons rated in_1964 by the OGR Policy’ Board was selec 


similar /grade ratings, (c) a sample of current (1974) officer }eb* descriptions was'selected to test the ~ Co 
_ reliabifity of MEK.raters, and (d) a package of materials and instruc was prepared for MET personnel 
_ toco lect and rate the officer job descriptions. * oe Le 


chmark Scale Job Titles i i 3 oa 


Approximately 25 experienced officers, with varied backgrounds, checked the sncsineh currency -. 

the 1966 benchmark scalé job titles to be used in‘the present study. In the event a particular job title was 
nsidered out of @ate it. was replaced with a current title. ‘From this evaluation process a nominal number 
of substititions were selected. The ten job evaluation factors and revised benchmark oii job titles. are : 
given in Appendix A. 2 ie : t 


ft 
. = Lj 


. 


Job Samples . .” 3 ' 

.A main objective of the present study was to determine if MET raters could produce grade ratings’ o 
having a high correlation with 1964 OGR Policy Board grade ratings. In arder to compare grade ratings ° 
between MET raters and the OGR Policy Board, a common set of job descriptions rated by both groups was\ 

. ‘required. For this purpose, the 1,000 Poof 8 in the Brokaw and Giorgia (1966) Benchmark scale-. 


*s 


study were checked for currency, and ple of 485 non-aircrew job descriptions was selected for the - / 
present study. To test the reliability of rategs between MET organizations, two copies of the 485 job / | 
descriptions were produced #nd divided sb that each description would be rated by at least two different a. 

\ MET organizations. A further. check on reliability between METs was accomplished by using ten of the i. | 
same 485 job descriptions to be rated by five different MET organizations ‘ 


A second sample of approximately 1,800 cyrgent officer positions was selected to test the basin we 

‘ ok MET raters. A primary requisite of the second sample was:that it be representative of the current 

_ Noh-aircrew population. To achieve a representative Sample, the 1974 Unit Detail Listing (UDL) was used . 

. to determine the population values authorized in each non-aircrew DAFSC and grade position. The)’ | . 

ion of sample size (N=1,800) to population (N=66,443).was obtained and multiplied against each — | 

AFSC 4nd grade position in the non-aircrew population to derive the Sraponinal representative sample. In — - i 
addition\a minimum of one job in each DAFSC’ and grade positian in the: non-aircrew. population was se 
‘i included — the sample. The 1,800 officer positions were then divided equally apie the 91 MET 


collected by gach MET. at ; / Saige As 


_ MET Raters. 5 , 


During Se/ptemBér 1974, HQ USAF, Director of Manpower and Organization, notified by letter. all 
major air co ds of the officer grade study and réque8ted the participation of 91 METs. Orbe job 
descriptions were collected by METs in @ctober"1974. For this phase of the project, the Air Force Human 
Resqurces Laboratyry (AFHRL) forwarded 2 package of materials and instrugtions to the MET commander-- 
at each of the’ 91 locations., The commander in turn appointed a project officer to comply with written 
instructions (Appendix B) to complete the project. Each project officer was provided a by-name roster-of 
the officers to be surveyed at‘ their MET location. The roster also provided alternate names with similar ' 
e 7 % *"s ie 3 c 


é 
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Job Descriptions Completed 


. characteristics, with a maximufn R 


sorted to control for rating context effects described by Maddeg (1960). 


“was compkted and retumed to the MET; ai ; : - 
Officer job description ratings by METs were ree during November 1974. Raters selected for 


the project included officer, civilian, and enlist personnel. ‘Administrative gnd clerical personnel 
were: not used as raters. Each MET rater w dependently rate se 31 officer, job 
desctiptiofis. Eleven of these descriptions were sicted Trom the 485 jobs in th study, and the 


remaining twenty were a part of the ‘1,800 descriptions collected from METocations. Project Officers were 


P alse to fold bgck each job desctiption so that only the job information on pages 2 and 3 could be 


read. Project officers randomly ‘integrated the recently collected job descriptions (approximately 20) 
with the- eleven OGR job descriptions and placed them in a folder. The job desttiptions were randomly 


a 

The job descriptions were then rated by project officers and MET raters, according to the directions 
on the rater ihstruction sheet (Appendix D). Each MET rater was instructed to use the 10 benchmark job 
evaluation factors and a grade code scale to rate each officer job description. The 16-point grade code scale 
was designed to permit discrimination of ee within grade levels and is shown in Appendix E. The 
MET ratings were recorded on a rating fom (Appendix F), which had been sari ae to record rater 
responses and personal background informatten about each rater. ; 


IV. MET 1974 RESULTS —_ 


> 


° e 
wh 


From the 1,800 officer positions sent to the METs, t,687 job descriptions were collected. The 1 687 


*& job, scriptions, combined with the 485..descriptions from the 1966 OGR study, totaled 2,172 job 


descriptions and are listed by DAFSC and VE UR eae in Appendix G‘. 
a & ¢ 


: MET Rater Characteristics : ~ % 


Valid data was received on'the 211 2,172 jobs from 685 raters across 89 of the 91 participating METs. Of 
these raters there were 369 enlisted personnel, 166 officers, and 130 civilians. The number. of raters at each’ 
MET ranged from 2 to 12 with a median of 7 raters per MET. 


Ratings on the variables ist the Policy Equation’ were averaged, sctehted, and Bree ta produce 
composite scores. Regression analysis, using the com site scores for each job as a criterion and background 
variables of the raters on each job as predictors showed the job scorés to be unrelated to rater 

of .0257?. These results imply that there were no indications of biased 
rati in relation to the background variables examined and that MET raters may be selected 
independently of.the background characteristics. 


Generally, from examining background data from the “MET rating form, it appeared that METs were 


well? qualified raters. Approximately 65% of the MET raters had completed the work methods and 


standards training course. The majority of Air Force career experience for'55% of the MET raters was in- 
management engineering, masfpower, or both. The average MET rater experience in management 
engineering was 77 months, and 32 months was the average experience at the currently assigned MET. 


Reliabilities of Job Sets yi. ‘ C 

* ‘The three job sets in the 1974 study consisted of 485 old jobs (from the 1964-OGR study), 1,687 - 

new jobs (collected by METs) and a set made up of these two sets paiiaie totaling 2, 172 jobs. Interrater 
a In 1964, authorized ‘grades were ieannded on Unit Manning Documents (UMD). In 1974, Brade re were 

post€d on Unit Detail Listings (UDL). . x ; 


2 The full model of the reereson analysis included the following 33 background predictor variables: 


Three dichotomous rater type variables (enlisted, of ficer, civilian); ’ 
Total months'in present MET (continuous); 


T-AF MS (continuous); 
Total months Management Engineering/Ma power experience (continuous); 
, 22 Major Command variables (dichot us); 
ME or AMETA training course completed (dichotomous); 
Four dichotomous career experience variables, j - 
‘ ° > q ( 


: are listed in Table 1. The interrater reliabilities were computed with ad tment for le size (by the 
z Spearman;Brown prophecy formula) as described by Lindquist (1953, p. 361). Sin liabilities on 
"composite scores of .94 or greater were obtained for each job set it appears more thaedequae to fer. 
. that MET raters rebably 5 1gted both old and new job descriptions: +. 


‘ ’ | ; : 
reliabilities based on the ten job evaluation factors, grade ratings and compgsite scores a. t the three j sets” . 


a 


ae, 8 al > SO Table 1. Interrater Relialy 
. Factors, Gradé¢ Ratings, and 


ts te sé 
ne ? \ * 
Experience 85. as 
: * 3 Working Conditions“ 81) 81 2 eg 5 
: ' 4 Originality, Ingenuity, and Ho 2 | , 
: e.g ’ Creativeness - am) lg 84 | 85 \ 
a ae 5 Communication Skills* . "87 84: i 
: 6 Interpersonal Skills “83 ae? 83 § 
ue 7 Judgment and Decision anne * SS 84 oN 84 . 
8 Planning* + 85, 86, ah 86. 
> 9 Management* =? Bf} 87, ee an Pn Wee 
van & “10 Risk ye aes oe en ee ee as ba 
‘ oe Grade* 90s |) See 2. . a“ r 
** Composite Scores - * i 394 95 5 | - 
er ry 
Used in Grade Equation. ‘ ‘ * . . 
~ a = Lad ‘ 
a . ‘ Ruy for.neven sie 4 7% 


Rater Group Reliabilities. 


Different rater groups, consisting of salen: officer and Gvilian personnel, were iderttified fete the 
total sample. Interrater reliabilities for jobs with two or more raters of each rater group were computed. 
These reliabilities were transformed by the Spéarman-Brown prophecy forntula to reliabilities based on an ; 
average of seven raters per job, and are reported. in Table 2. Reliabilities on composite scores of .94 or + 
greater were obtained for each rater type. These, reliabilities are adequate to state that ropadless of rater ie og : | 


type, MET raters can reliably rate job descriptions. . = : ae | 
fo "Table 2. Interrater Reliabilities of Composite Scores al aes 


__ by Rater Type for Jobs with Two or More Raters®. 


4 — F ‘ > 5 ? ee aerememeneerse r 2  t = ’ Pe 
. oi> Numper of : ' 


: ~  7t Rater fied 2 - Reliability® = Jobs Rated 
Enlisted - 94 Pe oe NB 4. 8 . 
4 Officer yr ~ BEF io * Nae 
YY ed Civilian ” 75 7 "4395 ! ” *698 ‘ a et RS 
Rs Combirled Rater Types ee ee ee ee 4 
. Computed by the an-Brown Prophecy formula for bis average of 


seven raters per job. 


‘ an Reliability of METs _ a : =: Se a. 
The interrater reliabilities on the composite s scores for each of the 89 METs participating in the study . 

es _ were also examined. Using an average of seven raters per job, 82 METs obtained an interrater reliability of 
oy -— .Q1-6r higher. and the reliabilities of remaining 7 METs were — 85, These ee indicate that ; 
.¢ individual METs provide high interrater reliabilities. 


. 


. * Four hundred and ahd jobs of the 485 job set.were rated ba tes (or. more) METs. A zero-order - 
Ho ‘oa correlation’ was Songapes be tween composite scores on each job (two sets of average composite scores . Po 
> €% being used when more\than two METs rated a job), producing a correlation of .91. In addition, ten jobs 
were selected to be rated by. five- different METs. Using average composite scores for each job within each - 
: MET, an inter-MET. reliability of .98 was obtained., Analysis of variance of average composite scores of the 
m ten jobs rated by the five METs were computed across the five METs anda non-significant difference was . 
oo of obtained (F = .1816; df = 4,45). These Sasa that given thé same sets of jobs, | ME1scon- ing 
( -, ateally assign the same grade ratings. . ‘-™ ° 


~ 


Validities of the Equation Variables | : ; fh - 5.198 


. 


‘Table 3_ presents validity coefficients for each of the nine equation variables and grade evaluation. Es 
composite scores correlated with the criterion board grade ratings. A high correlation was found between” 
the MET grade evaluation composite scores and criterion board grade ratings (r = .90). This high correlation | 
demonstrates that METs applying the grade evaluation procedure-assigned with:high correspondence the ; 
same grade level to‘each position as did the 1964 Policy Board.’ 
4 23 . a . 


Table 3, Validities of Variables Included in the 


> os BS 1 5 : — :‘MET- Applied Gradg Evaluation Equation By 3 
i ah Oe i a bank ae 
re oe Seung -. Vartabies : vanes ; : 
. ; . Factor 2 Special Training and Work Rept , + a6 RBP © : 
‘ - “Factor 5 Communication Skills ant 0) Page 8 Stet : et 
ee _ Factor 7 Judgment and Decision Making 73 ‘ 
Factor 8 Planning ~ . 8.78 3 
: Factor 9 Management . » (82 ‘ ‘ 
ay Level of Organization ' : E 48 t 
. Level of Job Within Organization = 9 --. i » 9° 7 
Sie ‘Supv Judgment of Grade for Job « ~ 9 = 3 ' 
. Mean MET Judges Grade Ratings 86 ee i 
; Final Grade Evaluation Composite 90 ? 


Ul 
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Grade Conversion Tables aa, Ot 


5 * , A grade conversion table, providing conversion of composite scores toa savedexoint grade scale and a 
; sixteen-point experience level scale, was constructed -(Table* 4). In addition to providing grade and 
_ €xperience level scores, the coriversion table serves the purpose of correcting for the statistical restriction in 
range on the composite: scores encountered when applying a weighted equation. (Christal, 1975). The . ; 
conversion table was based ori the 485 OGR job sample. Caution should be exercised in its use until a more * vd 
stable oe table is ibaa toe ona he criterion job sample. 


nt : 
s ° 
: ‘ = 4 - ait a! ‘ : a ; * . * 
: ; £2 rt 
, ‘ ‘ 
.* e is . * 


ma % ¥ .) : : F 


, Weigntea Canipaake? : 


+ Cumutative Score - 


Converts to 


Experience Lever” / 


. Converts to. 
Grade 


’ 300.1 and above : -'16 to be determined | 7 to be determined .f He 
289.1 to 300.0 | 15 Senior Colonel ‘ - 
26141 to 289.0 * 14 Middle Colonel - 6Colonel.  , 
238.8 to 261.0. ‘. 13 Junior Colonel \ 
276 to 238.7 "12 Senior Lt Cot , 
200;9 to 217.2 11 Middle Lt Col 5 Lt Colonel F 
183.5 to 200.8 10 Junior Lt Col : 
162.5 to 183.4 . " 9 Senior Major 
Z 143.9 to 162.4 8 Middle Major - 4 Major 
' ~ 122.1 to 143.8 7 Junior Major us : 
105.3 to 122.0 6 Senior Captain ia —~ 
80.3 to 105.2 5 Middle Captain 3 Captain 
65.5 to 80.2 ‘ 4 pnior Captain 
64.4-and below® 2 Lieutenant _2 Lieutenant 


'This table is based on data from a 485job sample and should be treated cautidusly in 
operational use until additional research is completed to produce a more stable conversation table 
based on a larger job sample. 


balthough supervisory and MET grade ratings at the general level are allowable, the conversion 
table does not recognize grade requirements above colonel. 


« _ 2 . s 
“At Re present time, the system is not designed to distinguish levels of lieutenant positions. 
‘ ‘ 


oi «oe 


‘ Vv. SUMMARY AND CONCLUSIONS 


The Officer Grade Evaluation study was conducted at the request of HQ USAF Director of 
Manpower and Organization. The purpose af the study was to test a technology by which management 
_ engineering teams (MET) could apply job evaluation factors to determine appropriate grade requirements 
yr officer positions based upon job content and responsibilities. The technology was applied to all officer 
sitions, excluding those filled by line pilots, navigators, physicians, dentists, and pemoniet not Dr suet to 

the constraints of the Officer Grade Limitations Act. f 


“The grade evaluation Technology had been initially developed in the time period of 1963—1966. At 

: this time a grade equation system assigned the same grade levels to officer positions as did a Policy Board of on 
- highly experienced colonels {validity = .92). The\ grade equation weighted together the following job 
evaluation factors: special training and work experience, communication skills, judgment and decision 
making, planning, management, organization level, level within organization, supervisor's qudeinent of 

grade, and field judge grade ratings. ce 


‘ In 1966, a set of benchmark scales was developed to replace the original relative scale used to rate the 
F job eValuation factors. The benchmark scales provided a control for context effects in applying the factors 
_ to individual officer positions on a one-at-a-time basis. In 1971 —1972 limited studies were accomplished to 
update the benchmark scales and to produce a refined grade conversion table to interpret composite scores 


into grade requirments. & F 


/ v WF 13). 
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. . 


* 


i 40 


nueee  @ 


_ by Hazel and Carpenter (1975) 


“s 


The" present” report has ‘been | gon with the isoileatioa, i? the ‘officer grade evaluation 


technology by METs to accurately detrmine’ officer grade requirements. Data. was retumed from 89 
CONUS MET organizations. These. METs|provided a total of 665 iating evaluations on two job samples. A 
485 job sample was used to test whether MET grades allocated to those jobs. would be the game as the 
grades allocated by the 1964 OGR Policy Board. A second sample of 1,687 Suneatiehicer positions was 
used to further test the-reliability of MET raters on current job descriptions, 


Based upon present: findings, METs using the grade evaluation technology assigned essentially the 
same grade levels to 485 officer positions aS did the 1964 Policy Board of highly experienced colonels 
(validity = .90). It appears that MET raters can ef! fectively replicate the work of the original Policy Board int 
determining officer grade requirements. . 


Interrater reliabilities within and between METS were also tested. In all cases, the ‘teljabilities obtained 
indicated that personnel within METs are highly reliable raters. In addition, regression analysis of rater. 
background information showed these variables to have little or no influence on rater behavior. A 
sixtebn-point grade conversion table based upon the sample of 485 job descriptions was constructed in - 
order to convert predicted grade composite scores into grade requirements. Using the conversion table, the 
485 .job sample was adequate for comparing grades. The current (1974) job sample of 1,687 job . 
descriptions was also sufficient for testing the reliabilities of MET raters. However, Christal (1975) cautions , 


« 4 


_that a sample of 485 jobs is considered too small to construct a stable conversion table and #,687 job 


positions are not sufficient for grade requirement projections to the total non-aircrew population. Paneer » 
sample sizes are needed to satisfy both of these requirements. 


VI. RECOMMENDA 


The grade evaluation technology tested demonstrated that METS can successfully determine aide 
requirements based upon job content and responsibilities. The technology is supported by years of research 
and ig one of the most defensible systems developed. d upon the findings of this report it is 
.recommended that MET application of the officer grade evaluation technology be adopted.: As a result of 
the MET 1974 study, a procedural guide for applying the gra e ‘evaluation technology ne been published 


A 


Before the grade evafelton technology becomes operational, it is recommended that a more stable 
conversion table based upon a larger sample be constructed. Minimum effort would be required to collect . 
MET ratings on an additional 500 to 1,000 positions from the original 1964 criterion board sample for 
constructing a stable grade conversion table. * 


If Air Force managers desire to know’ the grade requirements for the entire non-aircrew population, 
the MET ratings on an additional 10,000 to 12,000 officer job positions would be sufficient for this 
purpose. The grade projection technique developed by AFHRL could then be applied to this data to 
determine the grade requirements for each non-aircrew utilization field. - : 


x . x “ 
« is ~ 
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education required by the job. Consider 
ofessional school. 


ACTOR 1: ‘FORMAL EDUCATION: The amount of feen 
, the education obtained in high school, college, university, or 


. 


‘ ay 


* 


LEVEL 9 \ 


. + Staff Legal Officer, Military Affairs, Hq USAF 
Computer Systems Design Engineer-Mathematician, Hq Major 
Chief, jHallene Program, Pare Test Wg 


LEVEL8 ~ 


_ Physicist, General, Air Force Special Weapons Center 
Biocenvironmental Engineer, Environmental Health Laborat 
Assistant Program Manager, C-5, Hq Major. Air.Command 


EVEL.7 ° “4 


Deputy Commander for Maintenance, Strategic Maile Weg 
. \Electronic Systems lfstallation Officer, Electronics Installation Sq 
ae Chief, Munitions Div, ity Numbered Air Force 


‘ 


cat 4 se : “Wea? os f" : 


Chief Data Systems & Statistics, Combat Support Gp 0 eg a 
Deputy Commander, Combat Support Gp ro : aay a 

t Stat? " Elegtronics, Officer, Combat evaluation Gp : ‘ Sh ot 

LEVEL 5 .- savin x Se" 


issistant DCS/Personnel, Hq si eee Service 
Acrial Reconnaissance Weather Officer, Weather, Reconnaissance a 
Armament Staff Officer, Inspector General Gp x % : 


- 


ae | 


; LEVEL 4 Ys aan” b.% | : 3 
OIC Anwatient & Electronics Branch, Consolidated Aircraft Maintenance a ane? _ 
Chief /2ersonnel Div, Hq Combat Support Gp ° 


Electronic Warfare Officer, Strategic Reconnaissance Sq ; ; 


. 6 ’ 


} 


LEVEL 3” s od ip ot 


~ 


wae 


‘Chief, Photographi¢ Seevicns Branch, Aerospace Reconnaissance Technical We 4 
Chief Munitions Maintenance Branch, Munition Maintenance Sq are ; : .* 


Organisational Maint Officer, Interceptor Fighter Sq "| 
, : ao ih 


LEVEL 2/4 a ae af 
vw: Chief Transportation tatfic Managem t, Transportation Sq ; : 
_ Group Supply Officer, Aeromedical Evauation Gp a aoe 
Base Eset Officer, |Fighter Wg . soak, a * ‘ 
LEVEL i ae Oe at gee y 
* Vehicle Maintenance Officer, Transportation aa? , ict 36 > 2 il : . 
. Food Service Officer, Combat Support Gp * : : er Oy et ; - 
aie Sales Officer, Combat Support Gp é Sy eo Be ee . 
* . ze = “ : eo 1 fe ‘ \- . , ; 


1 \ 


Fy : 
- a] 


n 


. 


. ; = is Housing Officer, Combat Support Gp 


<LEVEL 6- is : PD Seas ' 


i + 4, = r ‘ $ 
FACTOR 2: SPECIAL TRAINING AND i doen ea atop ete to which the job requires 
knowledges and skills which must be acquired through special training courses or on-the-job experience. 
Disregard general courses given by Squadron Officer School, Command and Staff College, or War College. 
LEVEL® i cone : -. 5: 

Chief, Contract Pricing Branch, Hq USAF - ; 

* +Chief, Military Justice Division, Air Div 172 , 

Space Vehicle Research Officer, Hq AF Special Weaon Cane . Le a : 


L VEL8 : a ° 


**. Director, Reconnaissance & Electronic Warfare Operations, Major Air Command Et mg 


Minatemah Trajectory Engineer, Aerospace Reconnaissance Technical Wg : 
Chief, Missilé/Nuclear suey Division, Technical 1 Teaining Center . 
BEVEL? | c+ ; ; .* 

teste Combat Crew Commanter! Strategic Missile Sq : : et eS 

ief Target Intelligence Branch, Strategic Reconnaissance We ; a es 

pomiete Maintenance Operations Div, Aerospace Test Gp % Bis 

” ri . \ ne 
® . re 


_ Chief, Consolidated Base Personnel Office, Bémb We : 
” Flying Safety Officers Hq TacticalFighter Wg ~ ae ee 
Reconnaissance: anaes Compass Bisa Reconnaissance Sq 


J a a . 


levels FY , 
€y-pilot B-52, Bomb Sq ' ‘ cree "4 


* - 


Pilot,.Military Airlift Sq ~ . ; + 
Radar eealiattan Officer, Hq mae Air'Command (Overseas) - ; may 


“ *. . - “ 


LEVEL 4: ud . ety a aa : 
Chief, Airdio-Visual Center, Numbered Air Force = * So > 
Electronic Warfare Officer B-52; Bomb Sq_- : : . 
Education ‘Training Officer, Major, Air Command ; 4 - ‘i 
CEVEL3 | fe oe ss é a nae. 
Crypio Operations Of ficer, Communications Gp (Qverseas) _ | 
Avionics Otticen,Cohsolidated Aircraft Maintenance Sq ‘ ‘ " at 
Flight Line Maintenance Officer. Organizational Maintenancé sq a shes Re 3 
Levei2 - |< sgh : ee iD | 
Photographic Equinnnent Maintenance Officer, Avionics Maintenance Sq , es 
Chief, Pay & Travel Branch, Combat Support Gp ; : 4 
ie ace Officer, Technical a Sq rR ~F 
‘EVE ee Fog . ee 
FEVELG a om Fy 3 > 
pecial Service OF ficer, Fighter Gp - V*. ‘ 
transportation Officer, Instrumentation Sq ” . yp 


Pa _ P > 3 AS Siete. Te 


on 


A - x \ ‘ é = ‘ 


conditions. Consider such conditions as isolation, igregular hours, monotony, prolonged vigilance, 
extehsive TDY, and pressure to meet deadlines. - 


Pilot, Reconnaissance, Tactical Reconnaissance Sq (Overseas) - 
Tactical Fighter Pilot, Tactical Fighter Sq 
Instructor Pilot, FB-111, Bomb Sq : . vs 


LEVEL 7 rar . 


Pilot, Search and assis, Aerospace Rescue & Recovery Sq.” * 
Weapons Controiler, Aircraft Control & Warning Sq 3 : 
Instructor Navigator, Transport, Military Airlift Sq 

il a 


LEVEL 6 


t i 
Electrical Engineer, Site Alteration Task Force 
Director of Intetlizence, Numbered Air Foreé (Overseas) ‘ y 
Communications Security Officer, Mobile Communications Gp iy 


LEVELS 


Weather Forecaster, Weather Det 
Chief, Logistics Division, Military Airlift Wg ¥ 
Nurse Anesthetist, Medical Center 

a Fs . 

LEVEL 4. |. . : SS 

Transportation Officer, Transportation Sq, P< : 
Director of Manpowér and Organization, Air Division 
Chief Airman Personnel Division, Hq Major Air Command t 


a ; . . : = 


. LEVEL 3 


A+ Asst Staff Jutlge Advocate, Combat Support Gp. 
Clinical Psychologist, Medical Center — Moe 
Chicf Military Justice Division, AF Missile Test Center 


LEVEL 2 : : a 
Special Services Officer, Air Base Gp . 
Pharmacy Officer, USAF Hospital | 

! Staff Chaplain, Numbered Ay Force 

LEVEL 1 , ‘ 


Officers’ Open Mess Custodian, Air Base Gp 
Custodian, Non Appropriated Funds, Air Base Gp 
Information Otficer, Bomb Wg 


£9 


a | 


_ FACTOR 3: WORKING CONDITIONS: The extent to which the job involves uncomfortable wor hing p 


¢ ‘ : 1 c 
LEVEL 9, \ a 
Forward Airc Controller, Tactical Air Support sa (Overseas) : _ 
Co-pilot KC-135, Air Refueling Sq is : 
Commander, B-52, Bomb Wg | ; 
oe? alt ’ > ? 
LEVELB 4 a 4 


¢ J j } : 
( _ 


requires new and u ique methods, approacles, and eile mae Consider) the demand 
for novel ideas-and i 


v 


¥ 
* ae a F aie ee 
FACTOR 4: OF GINA ITY, if NUITY, ND CREATIVENESS: — the job 

rT 


entiveness, 


LEVEL 9 : ae ee ‘Ze 
Research Aviation Physiologist, USAF School of Aviation Medicine ¥ : s i ” 
Astronautical Engineer, Propulsion, Rocket Propulsion Lab , 

Human Perfurmance Engineer, Electronic Systems Div 


| 
| 
RAED | 

LEVEL 8 a. . , | - : 

_ Logistic Staff Officer, Hq Air Materiel Area . : . | = : 
Manpower Management Staff Officer, Hq Major Ajr Command +7 ° 
Director, Department of Aircraft Maintenance Training, Tech School | 2 

‘ + ‘ 
LEVEL:7 , “ eo 
, = | 
Missile Safety Officer, Air Force Eastern Test Range - 
* Base Deputy Conimander for Materiel, Combat Support Gp’ : f ; 
Managemegt Engineering Officer, Hq Air Materiel Area  * |: cis 
LEVEL 6 ; \ 


Civil Engineer, Civil Engineer Sq 
Chief Re-Fntry Vehicle Maintenance Branch, Missile Maintenance Sq 
Flying ai Officer, Tactical Fighter Wg 


\ { * 

LEVELS © ; : - 
Missile Combat Crew Commander, Strategic Missile.Sq oe ae a ee 
Reconnaissance Pilot, Tactical Reconnaissance Sq a 
Commander, Weather Sq i ae be ie yy #2 

‘i ; om 2? 

LEVEL 4 +>© : pee te 
Precision Photographic Services Officer, Strategic Reconnaissance Wg — 

Chief Transportation Traffic Management, Transportation Sq : 
Computer Maintenance Officer, Hq Major Air Command . 

LEVEL 3 ES ee 
Launch Area Maintenance Officer, Air Defense Missile Sq ov ( aks Ag 
Academic Instructor-Undergraduate Pilot Training, Student a : , Fe? 
Ciimeal Laboratory Mit USAF Hospital —_— are) 

ry 

LEVEL 2 : 

Asst Base Rauicael Mtnagernent Officer, Supply Sq ; e ih 
Co-Pilot B-52, Bomb Sq - oF ~~ 
Accounting & Finance Officer, Combat SOpP rt Gp * ( . 

’ - 

LEVEL1 ” ‘ 


Asst Medical Supply Officer, sisal Gunter 
Optometry Officer, USAF Hospital : 
Chief, Administrative Services, Air Base Gp” 


Sy 


FACTOR 5: COMMUNICATION seikcs The extent to which the job requires skill in gral and 
written communication. Cortsider the complexity and variety of information communicated as well - 


as- ca ‘i of the individuals and agencies involved. 


s LEVELS = " 


Director of tnfouniatien. Hq Major Air Command = 
Political Military Affairs Officer, Hq USAF. 
» Secretary of the Air Staff, Hq USAF 
. x s Fh 
“LEVEL an ‘7 : 
Chief of Logistics Division, iia Nuinbered Air — ae 
Astronautical Engineer, Hq Space’& Missile Systems Org | 
OSI District Commander,-Hq District OSI 
| LEVEL? alge Fs 
Base Civil Enghicer. Air Base Gp 
8 ~ Human Performance Engineer, Electronit Systems Div 
Saege “ce - Gomptrlie, Air Bale We 
\ -. 
LeveL 6 & y . 
‘Aviation Physiologist, Inspector Genseal Gp 
Chemical Engineer, AF Aero Propulsion Lab 
Administrative Officer, Electronics Installation Gp 


LEVEL5 — 


r Officer Selection Officer, Det, USAF Recruiting Gp 
Deputy Commander, Strategic Missile Sq 
3 ter 7, Chief, Sensors Section, AF Special Weapons Center ~ , 


LEVEL4 . ‘ 


- Construction Engineer, Civil Engineering Sq (Overseas) t 
a “Squadron Operations Officer, Combat Crew Training i 
* Accounting & Financé Officer, igaes Gp 


LEVEL 3. Mog | tga: Maa 
* Commercial Transportation Officer, Materiel Sq 


- . Avionics Officer, Aircraft Control & Warning Wg . ee 
Mussile Maintenance Control Officer, saioon Missile $q = 


» 


~ Lever2 ae Fe , 
_ Fighter Interceptor Pilot, Fightei Intercetor bee 


= Strategic Missile Complex Maintenance Officer, Strategic Missile S4 
Elegtronic Warfare Officer, Tactical Reconnaissance Sq 


Co- pilot, Air Refueling Sq: “ P 
. Navigator, Bomb Sq . R 
sid eink Aerospace RescGe & Recovery Sq 


a 
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FACTOR-6: INTERPERSONAL SKILLS: The extent to-which the job requires skill in dealing 
with people. Consider the need for sensitiveness, sponsiveness, persuasiveness, self-control, - ~ . i 
and tact, as well\as the posibis it ira when such skills are not employed. | q ws 
LEVEL@” “QO” at Here oe 
Staff Chaplain, Numbered Air Force eer: <i 
Political Military Affairs Officer, Hq USAF ., ; 
Commander, AirRefuelingWg a \ oe . “of 
oe én \ 4 *, 4 
LEVEL ls . Me, 
, Asst Professor of Economic USAFA ' ¥ 
* ‘Academic Instructor, Dept o Chemistry & Physiology, USAFA Ren 
Security Staff Officer, Hq Majog Air Command ae, oa 


LEVEL7 we : . “ ; ‘ ay 
Commissary Officer, Air Base Gp 
Wing Director of Safety, Bomb Wg ; - r 

OSI Detachment Commander, OSI Det iad ‘ ' 


s ‘ 


i ‘ 
LEVEL 6 ; Noose 


Base Procurement Officer, Flying Training . s et 
Instructor Navigator Bombardier, Flying Training Wg oe ig 
Comptroller, Air Materiel Area. 4 Bo a Be ‘. : 
; ers aaa oe 
LEVELS " 


Communications-Electronics Staff Officer, Hq Majo Air Command . a 
Base Supply Officer, Combat Support Gp in : i 
Chief Accounting and Finance Division, Combat Suppdoyt Gp’ : 


*EVEL@  *: , 


Special Services Officer, ServicesSq , , 
Chief, Medical Materiel Services, Medical Center 
Maintenance Supervisor, Avionics Maintenance Sq 


_ LEVEL 3 — 


> Air ‘Freight Supervisor, Aerial Port Sq 
Airborne Eléctronies Maintenance Officer, Fighter, Interceptor Sq 
Construction Engineer, Civil Engineering Sq (Overseas) ° 
LEVEE2 : , aa = 
OIC Photo Laboratory ,.Reconnaissance Tech Sq __ ; 
. Avionics Officer, Avionics Maintenance Sq . ss, 
’ Precisio’n Photographic Services Officer, Strategic Reconnaissance Wg “3 
LEVEL 1. ae. Bs . 


_OIC Weapons Services Branch, Munition Maintenance Sq ' ; 


Navigator, Air Refubling, Sq 


* rd 


=Co-pilot, Air Refueling Sq , . y 
: 2 #°© / 
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* ~ |. FACTOR 7: JUDGMENT AND DECISION MAKING: The tnipodiains and iaeenntanes of fadutnanta® 
_ and decisions required by the job. Consider the nature, variety, and possible impact of decisions. 
The fess well defined the guidance for decisions, the higher should b id be satin while the more ~ 
Specific and detailed the guidance, the lower should be the rating. 


‘LEVEL 9 zy a gar 
~ Chief, Budget Div, Hq Major Air Command j sal 


‘Staff Legal Officer, Military Affairs, Hq USAF : 
, Cmef, Weapon a ail Testing Div, & Missile Systems Org 

LEVEL8 e i. apav 
Deputy Commander, Combat Support Gp © “sates : : ate nee ? -e 
Missile Maintenance Inspector, IG, Hq Major AirCommand _ - .  -s 

* , DCS/Comptroller, Hq Numbered Air Force (Overseas) . * ‘ ; e 


LEVEL7 as eo 
Logistics Of ficer, Space & Missile Systems Org 


‘Experimental Flight Test Officer, Hq Aeronautical Systems | Division 
Chief of Personnel, Combat Support Gp 


LEVEL 6 


Commander, Organizational Maintenance Sq 
Missile Safety Officer, Strategic Missile Wg 
Missile Combat Crew Commander (ICBM), Strategic Missile Sq 


LEVEL5 


hag ; ; - ; J ° 
Maintenance Officer, Strategic MissileWg rf XY » 
Buse Operations Officer, Combat Support Gp , By? . ( 
Aite raft Commander KC-135, Air alles Sq 


‘LEVEL 4 : : 
Munitions Maintenance Supervisor, Munitions Maintenance Sq 


VIC, Maintenance Analysis Branch, Communications Area © 
Fighter Interceptor Pilot, Fighter Interceptor Sq 


‘LEVEL 3 


Reconnaissance Pilot, Tactical Reconnaissance Sq 
Pilot, Transport, Military Airlift Sq 
- Special Services Offiter, Services Sq 


LEVEL 2 4 


Traffic Management Officer, se snamirale Sq. 
Fuels Officer, Air Base Gp 

Helicopter Pilot, Combat Sypport Gp 

: oe . ‘ 


e 
LEVEL‘ , 


Recreation Services OWicer, Combat Support Gp’ 
Pharmacy Officer, USAF Dispensary 
Photographic Officer, Reconnaissance Technical Wg 


‘ ae ae : 
z : . 20 


FACTOR 8: PLANNING: The extent to which planning is required by the job. Consider the scope 


ay 


and significance of work for which planning is done. The logger the tie span for which planning is 


done, the higher the rating should be. 


LEVEL 9 
Deputy Chief, Plans Division, Hq Major Air Command 
Asst Director of War Plans, Hq Major Air Command 
Director, Joint Operations Task Force, NORAD 
d * 


LEVEL @ fF. 2 


Chief, R & D Contracts Div, Air Force Special Weapons Center 
Management Engineering Officer, Air Materiel Area 
Wing Logistics Officer, Air Refueling Wg 


LEVEL Z 


Maintenance Control’ Officer, Bomb We 
Deputy Conimander, Combat Support Gp 
Budget Officer, Air Base Gp ~ 
ti 
LEVEL 6 « 
Operations Orticer, Fighter Interceptor Sq mt 
Hospital Administrator, USAF Hospital i 
Chief, Data Services Division, Combat Support Gp * 


LEVEL 5 , & 


Chief, Career Control Branch, Air Base Gp. 
‘Traffic Management Officer, Transportation Sq 
Procurement Officer, Combat Support Gp - 


LEVEL 4 


\ Missile Combat Crew Commander, Strategic Missile Sq 
\ Wing “Acourlistration Officer, Military Airlift Wg 
“Weapons Officer, Tactical Fighter Wg 


LEVEL 3 © 


Elvctronie Warfare Officer, Bomb Sq 
‘Medical Administrative Officer. USAF Dispensary 
Revonnaissance Pilot, Tactical Recon Sq 


LEVEL 2 


Fighter Interceptor Pilot, Fighter Interceptor Sq 
Registrar, Medical Center 
Security Police Officer, Security Police Sq 


LEVEL1 


Hheht Nurse. Acromedical Evacuation Sq (Overseas) 
Weather Forecaster, Weather Det . 
Optometrist, Medical Center 


—_ 


, "4 


ao 


orm 


Ih 


FACTOR 9: MANAGEMENT: The fev of executive, and managerial skills-required in the job. : 


Consider ‘the complgxity , variety,, and level of the activities which are directed; organized, 
coordinated, pontrolled, commanded, or evaluated. ; ,; 


LEVEL 9 “ ; : * ioe Ge of ae 
* Director of Budget, ‘Hq Major Air Command 
Commander, Combat Support Gp (Overseas) 


\ ; i 
Wing Commander, Tactical Control Wg (Overseas) , <>. = s4 . 
LEVELS °°, arg Uy hh Sige Ow 
Wing ( usr anuiite Aerospace Rescue, &. Recovery Wg - oe i > 
. Chief of Operations, Strategic Missile Sq a5 ( cp al on ; 
Deputy Cominander, Air Base Gp tg : = ae 
° : ; ” a 4 a . . ‘ 4 4 ‘ 
VEL7 / + A 4 7 
intenance Supervisor, Avionics Maintenance Sq : 
® Squadron Operations Officer, Combat Crew Training Sq “ 
« Base Accounting & Finance Officer, Flying Training Wg : z 


LEVEL 6 De se 8 ‘ 2? Oa 
Chief, Consolidated Base Fecionuial Office, Combat Support SP ‘ 

% Base Procurement Officer, Pilot Training Wg 
Helicopter Sa ueteon Operations Officer, Flying Training Sq 


- 


LEVEL5 


Traffic Managcinent Officer, Transportation Sq 


Base Communications Maintenance Officer, Communications Sq (Overseas) 3 
Missile Combat Crew Commander, Strategic Missile Sq 


"LEVEL 4 = 


Chief, Utilities Operations Division, Civil Engineering Sq 
Chief, Photo Evaluation Branch, Photographic Sq ; 
Base Fuels Officer, Supply Sq ; a 


Tee Ny ‘ 
LEVEL 3 “ 


Primary Pilot Training Instructor, Pilot Training Sq 
Space Surveignce Officer, Aerospace Support Sq ‘ 
Air Traftic Controller, Communication Sq ti : os 


LEVEL 2 ' aa 


‘Administrative Otficer, Air Base Sq ms f 
Dat. Services Officer, Combat Support Gp - j ‘ : 
Tactical Fighter Pilot, Tactical Fighter’ Sa , 


LEVEL 1 Foun Rig” : coe 4 , 
Clinical Psychologist, YSAF Hospital | ; 


Psychiatrie Soctal Worker, USAF Hospital 
Hehcopter Pilot Single Rotor, Air Base Sq ‘ 


~ 


Tt races 
F cTOR 10: RISK: The extn to which the fas error exposure to s of death or severe 


injury in peace-time. 


LeveL 9 


Sailward ‘Ais Controller, Tactical Air Support Sq (Overseas) he . 
Tactical Fighter Pilot, Tactical Fighter Sq hs 
Instructor Pilot; Tactical da Combat.Crew Training ca : =) 


oP 


LEVEL 8 


Pilot, EB-66, Tactical Electronic Warfare Sq (Overseas) 
_ Navigator, Troop Carrier, Military AirliftSq 
"Helicopter Pilot, pee Rescue & Recovery Sq 


LEVEL? wus 


Instructor Missile Launch Office ‘Biches Missile Sq eae ee 
Arctic Survival Training Officer, Strategic Wg (Overseas) 4 
Chief, Propellants PREPS Br, AF Rocket Propulsion Laboratory . 


LEVEL6 . \ 


Commander, Radar Sq oe 
Regearch Biochemist, School of Anivepace Medicine 
cheraa Air Force Materials Laboratory el 


LEVEL 5. : 


Chief, General Investigations Div, Hq District Osi 
Base Veterinarian, USAF Hospital ; ’ a 
Commander, Civil Engineering Sq ay 


LEVEL 4 


Mechanical Engineer, Space & Missile Test Gane. 
Air Traffic Control Of: ficer, ‘Communications Sq 
Instructor, Institute for Professional Development 
LEVEL 3 , re , £2 shag A 


Médical Supply Officer, USAF Hospital 
Chief, Engincering Standards Branch, Communications Region 
Chief Machine Processing, Air Base Gp a. 


‘« 


LEVEL 2 


Recreation Services Officer, Combat ee Gp - 
Chaplain, Combat Support Gp i 
Manpower Marvageenent} Staff Officer, Flying Training Wg 


* . 


LEVEL 1 


Custodian Non Appropriated Funds; A Air Base Weg 
* ‘Clothing Sales Store Officer, Air Base Wg 
Instructor, French, Dept of Foreign Languages, USAFA * 


( «= @ 6 
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APPENDIX B: PROJECT OFFICER INSTRUCTIONS | 


Each MET project officer is responsible for accomplishing the steps specified in Phases I and II below. 
Review all materials in your package before proceeding. 


PHASE I - , . eg 

~ . Step 1. According to available records, the officers listed in sitachieat 2 are assigned to your base. 
Each officer with a red check by -his name will be requested to complete a job description survey form (see 
“attachment 3). Contact each officer with a red check by his name and, if he is available, forward to him one 
of the brown envelopes containing a job description survey form and letter of instructions. A substitute to 


complete the job description must be obtained for each officer who is not available. Substitutes should be 
selected in the following order of priority: - 


. 


a. The officer’s replacement, if on base at least six weeks. 

_ b. Another officer in the same grade and DAFSC (see attachment 2). ‘ a. 
c. Another officer in the same grade, and related DAFSC. 2 
d. Another officer in an adjacent grade but in the same DAFSC. “ 


Step 2. The- officer job description surveys are to be completed and retumed to you within 15 
working days after their receipt by each individual officer selected. Contact, each officer at the end of the 
first’ week to insure they received the job description: survey and are making progress toward its completion. 


Step 3. Upon return of all the completed job description surveys fold each description so that pages 2 
and 3 of the job description are on the outside. Take out the job descriptions that are already in the job 
description folder (attachment 4) and randomly mix these job descriptions together with the new job 
, descriptions you have obtained. Fasten all of the job descriptions, back into the folder, seater sure that 
_ each job wescniptions is folded back so that only pages 2 and 3 may be read. 


PHASE II 


This ed requires Sou and all available manpower and management engineering personnel at your 
location to rate each job description in the folder in accordance with the Rater Instructions (attachment, 5). 


Administrative and clerical personnel will not be used.as raters. If more than twelve qualified raters are - 
available, obtain ratings qnly from the most experienced twelve. After the raters’ have been pet ; 


accomplish the following steps: . 2 


First; in accordance with information on the Rater Instructions (attechiieat 5), you will rate the 
Officer Job Descriptions (attachment 4) and fill in the required information on the Rafting Form 
(attachment 6). Make sure that the job numbers are filled in correctly and that there is a factor an grade 
code rating entered i in each block, -« 


Second; have each of the other raters complete a Rating Form and independently accomplish the job 
ratings. In each instance, you will review the Rating Form for completeness. 


Third; when all ratings have been completed; inclose all study materials in the pre-addressed envelope . 


eg N and forward the package to the Occupational Eowaph Division, AFHRIK Lackland AFB 
3 tet 


*The Project’ Officer insteitions were contained ina letter to all MET commanders and included 7 
attachments. ~ | 


ATTAC NTS 
1. Project Officer instructions 5. Rater instructions 
2. Roster of job inc nts ; 6. Rating Forms 
3. Job description surve; oe: __ 7, Retum envelope 


_ 4. Job description falder, | 
ry ee fl ) ! € 
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APPENDIX C: AIR FORCE OFFICER JOB SURVEY 
3 5 Y » 
\ 
4 
tx 


AIR FORCE OFFICER JOB SURVEY 


ie Yee INSTRUCTIONS 
* This survey is directed by Hq USAF to identify and describe the-work performed by officers in the Air Force. The 
Air Force needs precise information about the duties, tasks, and requirements of officer jobs in order to maintain the 
classification structure, to make appropriate grade allocations, to define incumbent qualifications, and to guide other 
manpower and personnel actions, Parti icipation in this survey gives you an opportunity to provide accurate information 
about your job in support of improved Air Force management. 


Ybdu are requested to complete the’ survey according to the following instructions: 


_ 1, ASSIGNMENT INFORMATION ae 4): Fill in the required data or bare the\one box in each block that 
‘applies to you. ° 2 \ 


2. JOB DESCRIPTION (Pages 2 sa 3): On these pages provide typewritten* information which sorutataly and 
‘comprehensively describes your job. F : 


i 


a, In the JOB NAME OR TITLE block, record a name or title » which i is descriptive of your job. 


b. In the JOB CONTEXT block, locate your job within the organizational Structure. | 
‘Examples: (1) THIS JOB IS IN THE REANY EQUIPMENT BRANCH DIRECTLY UNDER 


THE BASE MOTOR POO 


MANDER, WHO REPORTS TO THEM&S 
\ GROUP COMMANDER, , 


(2) THIS JOB IS IN THE TARGETS SECTION OF THE OPERATIONS 
PLANNING BRANCH OF WING HQ. 


c. In the blocks under DUTIES AND TASKS, list statements that describe your job. Consider significant work 
activities such as thosé involved in commanding, planning, organizing, directing, monitoring, coordinating, 
reviewing, inspecting, evaluating, supervising, and operating. Use as many blocks as you consider necessary. 
The statements you provide should clearly define your job. ; i) 

Example: Duty A. DIRECTING MATERIEL CONTROL FUNCTIONS 
TASKS (1) ASSIGN PRIORITIES TO REQUISITIONS 
w (2)-COORDINATE REQUIREMENTS FOR MOBILITY DEPLOYMENT 
(3) MONITOR SUPPLY BUDGET 
(4) PROCESS REQUESTS FOR LOCAL MANUFACTURE OF ITEMS 
(5) REQUISITION TIME CHANGE ITEMS 
First, list all the. major duties you perform, then gd back and list the appropriate tasks under each duty. 


Describe your normal job. Omit temporary variations in your work which are not part of your regular 
assignment, Ignore additional duties unless they constitute a significant part of your job. e 


d. In the JOB REQUIREMENTS block, enter additional statements that describe any unusual requirements of 
your job for the factors below. ‘ 
COMMUNICATION SKILLS ORIGINALITY, INGENUITY, & CREATIVENESS MANAGEMENT 
INTERPERSONAL SKILLS SPECIAL TRAINING & WORK EXPERIENCE PLANNING 


WORKING CONDITIONS JUDGMENT, & DECISION MAKING A Risk A 
FORMAL EBUCATION ~~ ipeonns 


Examples: (1) WORKING CONDITIONS: JOB REQUIRES APPROXIMATELY 
ODAYST A ALLY. 


(2) PECIAL TRAINING & WORK EXPERIENCE: JOB REQUIRES A 30-DAY AF 
SOUnSEIN iN SPECIALS WEAPONS DELIVERY, . 
. In the JOB SUMMARY Block, write a three-or four-sentence summary description of your job. 


f. After you have completed pages 2, 3, and 4, sign in the space provided on page 4 and submit this fori Eo 
SuBErvaah 


NOTE: Siinewisor will review all entries, check a box to indicate his judgment of the most appropriate grade level for 
this job, and sign the form. \ , 
; i 


JOB NAME OR TITLE 


| JOB CONTEXT 
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AF OFFICER JOB SURVEY 
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.4 vo iin) 7 ae <a lasa-ay” 
et ASSIGNMENT INFORMATION / 
LAST NAME > . > at, *-RIRST NAME 


ORGANIZATION (5-40) . trea BASE OR INSTALLATION fa -80) 
~ ~ . 


, F ° . _ ih 


YOUR PRIMARY AFSC, * MAJOR AIR 


of Cer cbr 


Number : AAC | | A 
(2:5-13) 
UMD AUTHORIZED YOUR DUTY AFSC usaFA [] 8 
GRADE FOR YOUR ne Oc: 
meanen a) A och} 
ad ; ar usAFE []} 0 
(22). * Pretix Number Suffix A 
Overage ~ L]\A oO i | - (25) (26-29) - 
TOTAL ‘MONTHS IN 


Len ; a YOUR DUTY AFSC. - hea) § 


(31-33) 
Cl)? 
TOTAL MONTHS 
Oey ACTIVE FEDERAL 
0 : MILITARY SERVICE 
: 5 


Li* 


SEX 
(check one) ne a iia 


LEVEL OF YOUR - LEVEL OF YOUR . HIGHEST LEVEL YOUR MAJOR FIELD 
ORGANIZATION - JOB WITHIN OF YOUR OF STUDY 


: (39) YOUR ORGANIZATION EDUCATION (42) i. 


DOD,’ . : 

Ha USAF ‘i % e ee Education Ey 
Command Non High oO : : 

Ha Maj Alr oO Element School Grad 1 Physical o 2 

Comd + 8 | Directorate, High School ja Science 3 4 1B 

Numbered AF _  -y‘__| Dept, Office’ Grad 2) | arts, 3° USAFSS uy 

(or Equiv) O 7) |r Equiv) 1 Year Humanities 3 : 


Air Division Division (or Equiv) “ay 5 College oO 3 Enitiearing oO ‘ AFcS.. O ¥ 
(or Equiv) O 6 


Branch ". 2 Years = Other z 
Wing Gtres % [(or Equiv). fs 4 College Ol - Business, oO O 
~ Equiv) ae re tee ae sf Management . 
roup (or Equly) . Celtege Medical —— 
A (or Equiy 1 : meester ® Specify 
: é i _Junit = Bachelor's 0 east ‘ 
Squadran _ 4(or Equiv) Le Degree ~ © LSS bsociar” : 
(or Equiv) —~ O 3 Some Post- y | Science ‘ SUPERVISOR'S 
Detachment Othwy tSpecityy Grad Work O 7 Mititary JUDGMENT 
(or Equiv) O 2 $ Master's oO 8 ' Saitek : t ‘sieementnee 
Other (Specify) pS ee Ye a ; Other (Specityy GRADE FOR 
i ctora’ ok 3 : : 
Degree De : ' ‘| ° THIS JOB 
sm X * (43) 


Oe 
O13 
Oe 
REVIEWED BY: 3 . ECE . OF 
Oe 


Signature of immadiata ‘Supervisor 
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ee : APPENDIX D: MET RATER INSTRUCTIONS 


This research study is designed to develop and test a + is poe by whist management seigtiaaiig 


a number of officet jobs on 10 job Ho factors and (b) to estimate the ca required to perform the 
job according to\the grade code scale provided. Your independent judgments on the evaluation factors and 
the proper grade code for each job are required. For this reason you are ae to confer with any other raters 
about the ratings. a" , 


1. Complete all f page 1 of your Rating Form except for the remarks section. If you fecal 
remarks, write them in. after completing all ratings. Print all information neatly and legibly in the 
appropriate spaces orwvidi 


2. Review all of the factors on pages 1 through 10 following these divectinna: Notice that each factor 


has 9 levels which are defined by representative job titles. Your task is to read each job description in the 
job description folder and rate them on each of the 10 factors. For example, after reading the first job 
description, you will rate that job description from 1 to 9 on Factor 1, Formal Education. If you feel the 


job description requires about the same level of education as'the job titles listed at level 4 of the formal - 


education factor, you will place the number 4 on the Rating Form under Factor 1. Then, rate that job on 
all the other factors (2 through 10) following the same procedure. In each ia study the factor 
definition and job levels before making your rating.’ 


*3. Next, you will turn to the last page following these directions (page 11) wid decide what officer 


grade should 'be authorized for the job described. Do this by writing the proper number from the Grade ' 


Code Listing (1 to 16) into the Grade Code box on your rating form for the job humber you are rating. 
‘ Notice in the Grade Code Listing that there are three numbers associated’ with each grade level except 
General. The three numbers,in a set are used to show three levels of experience. For instance, a 4 represents 
a captain with a short time in grade, a 5 represents a captain with:an average time in grade, and a 6 
4epresents a captain with alongtime in grade. 
- 4, Now take the job description folder. Notice at the top of each description there is a number. Write 
this nisnibee in the first block under the column labeled JOB NUMBER on page 2 of your rating form. 


5. Now read the first job description and rate it on all 10 factors and the grade. code. Then rate the 
_ second jdb description and continue until all job descriptions have been rated. Be sure to place the job 
number -for each description in the appropriate JOB NUMBER block on your rating form before rating that 


job description. If any of the job descriptions you are rating appear to include outdated equipment or 


organizational level, proceed as if the descriptions were current, _, 
‘When you have finished rating each of the jobs, return all materials to your project officer. 
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RATING FORM 


FIRST NAME 


ORGANIZATION AND BASE 
’ 


SOCIAL SECURITY ACCOUNT CHECK YOUR CLASSIFICATION/STATUS 


2 BESREMEEE Sa | a! ae ae 


wae a . SUFFIX 
(18-19) - E1-E9 01-06 
re 5 


|; YOUR AIR FORCE DUTY AFSC : YOUR PRESENT GRADE 


(27-28) 
TOTAL MONTHS AT PRESENT MET 
: 
2 (32-34) 


TOTAL MONTHS EXPERIENCE IN MANAGEMENT 
ENGINEERING/MANFOWER 


* 


(38-40) 
MAJOR COMMAND (41) 


Ea (ince lee 
[Jase Be ae {Jom La ne aa 


[Js Ce Ty ‘USAF A mo [Jesse fms [roe Fars 


HAVE YOU COMPLETED EITHER THE ME or AMETA WORK METHODS A AND. STANDARDS TRAINING 
COURSE? po RS BEES 


. bs Abs, 


MAJORITY OF AIR FORCE CAREER EXPERIENCE SPENT IN: (CHECK ONE) 
t £ 4 


. am . 


‘ < ad 
1 [_] MANAGEMENTENGINEERING =~ 3 [_] BOTH MANAGEMENT ENGINEERING 
AND MANPOWER 


2 L] MANPOWER : . | OTHER 


“ 


(SPECIFY) (4a-78) 


REMARKS SECTION 


00 am oy 
02 a 


Note. — A = 1,687 Job Sample including 12 missing data and‘28 overages. B = 485 Job Sample. : P 
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43 7 ; 1 
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51, 3 1 24 1 "15 A 8 5 
, SS). 4! , 9 4 -*22 8 13 3 10 r 5 4 
57. : 3 4 1 3 
60 1 2 11 2 13 5 3 1 1 1 
62 s 2 8 3 4 1 2 
63 2 1 2 2 1 1 1 
64 5 1 16 2 ret 2 16 3 rr 2 
65 7 ‘ 16 5 1 6 4 
66 8 5 1 8 2 
67 1 3 10 18 8 | 4 3 . 
69 . 3 3 . 
A 70. 11 3, 45 1 8 6 11 2 1 1 
73 3 1 33 33 22 ‘4 18 4 2 
+ 74 1 23 s 2 2 5 Z 1 1 
75 > 2 5 a ye 2° 5 3 2 1 
79 ‘L 6 3 a? 1? 1 1 3 
80 2 2 24 7 8 6 4 4 
BI oie 2 9 6 1 2 é 
BT Besson : 
88 1 1 2 1 4 10 3 1 i 
> 89 1 20 2 5 4 3 rt 2 1 
+ 90 : 3 2 rig a3 “3 3 6 5 1 
91 ow 6 é of a 3 2 1 1 
92 3 4 7 4 et 5 - : * 
: , 97 4. 7 42 4 rh 2 5 1 1 
g 99 4 1. 4 "a ‘ 4 - 
Unknown if S 
AFSC 3 ; 13 4 3 
Totals 142 92 657 139 420 126 307 80 121 48 
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